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ABSTRACT 


Crowd simulations have many benefits over real-life research such as in 
computer games, architecture and entertainment. One of the key elements in 
this study is to include elements of decision-making into the crowd. The aim 
of this simulator is to simulate the features of an intelligent agent to escape 
from crowded environments especially in one-way corridor, two-way 


corridor and four-way intersection. The addition of the graphical user 
interface enables intuitive and fast handling in all settings and features of the 


Keywords: Intelligent Agent Simulator and allows convenient research in the field of 
Craw intelligent behaviour in massive crowd. This paper describes the 
Intelligent Agent development of a simulator by using the Open Graphics Library (OpenGL), 
Support Vector Machine starting from the production of training data, the simulation process, until the 
Geel Force Modal simulation results. The Social Force Model (SFM) is used to generate the 


Oncack: motion of agents and the Support Vector Machine (SVM) is used to predict 
P the next step for intelligent agent. 
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1, INTRODUCTION 

Crowd modelling has become increasingly important over the years due to its wide range of 
applications. Its extensive use can be seen particularly in movies and computer games. Movies such as The 
Lord of the Rings series, Hugo and World War Z embrace virtual crowd due to the lower cost of generating 
crowd rather than hiring extras. Games such as the Assassin’s Creed series, on the other hand, model crowd 
to improve gamers’ experience, making the gaming experience more realistic. 

There are basically three approaches to model the crowd. The first approach is by experimenting 
with humans in real-world. This approach is used particularly in the aviation industry, where aircraft 
manufacturers need to test the evacuation effectiveness of new aircrafts to get approval from the air safety 
authorities. Unless there is no requirement from the authorities, this approach is difficult to carry out due to 
the ethical and legal concerns [1], [2]. 

The second approach uses real-life animals through experiments such as in [3]. It is a relatively new 
approach in the crowd modelling research field [4] and is mainly used to simulate emergency situations. This 
approach was introduced as an alternative to the first approach due to the lifelike nature between the motion 
of humans and animals such as ants. However, this approach has one major drawback. Parameters such as the 
velocity, and the starting and target positions are difficult to control. 
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The third approach requires researchers to develop a simulation in order to create the virtual crowd 
[5], [6]. This is the logical approach for most researchers due to the constraints and drawbacks of earlier 
mentioned approaches. There are many ways to develop the simulation system. This includes the use of 
analysis and designing tools such as MATLAB, game engines such as Unity and graphics Application 
Programming Interface (API) such as the Open Graphics Library (OpenGL) [7], [8]. 

Therefore, the purpose of this work is to develop an intelligent agent that can make decisions for the 
next step position in a dense crowd simulation within the shortest time possible. Since it is difficult to 
describe the decision rules in an explicit form, a machine learning technique which is the Support Vector 
Machines (SVMs) by Vapnik is implemented. SVM is widely used in many fields such as image 
classification [9], [10], motion rules learning [11] and walking motion recognition [12]. The results of this 
work are shown in the Intelligent Agent in Massive Crowd Simulator. This simulator clearly shows how the 
intelligent agent can decide which route to choose to reach the target position. The user can make several 
choices such as agent type, agent form, number of agents and others. 


2. RESEARCH METHOD 

The system is divided into two main components. The first component is the training component 
which is responsible for the training of intelligent agent, while the second component is the simulation 
system which is responsible for simulating the decision-making capability of the intelligent agent in the 
Social Force Model (SFM) environment. 


2.1 Agent Control and Collision Avoidance using SFM 

The SFM was originally introduced by [13], and is one of the microscopic techniques in crowd 
simulation. It presents an idea that the internal motivation of agents to perform certain movements will affect 
their motion. Throughout the years, many improvements are made to the original model. One of the latest 
improvements is made by the researchers in [14]. In their research, the model parameters are calibrated to 
match the results of the experiments they have conducted in the real-world crowd. 

The model describes the motion of an agent as the combination of a driving force component and 
two repulsive force components. Each component is calculated for every agent in the simulation. For every 
agent i, its social force f; can be represented by Equation (Equation) |. The relationship of these components 
with its surroundings is illustrated in Figure 1. 


fi=forpee + fe’ (1) 
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Figure |. Social forces 


The first component f), is the driving force for agent i. It reflects the motivation of the agent to 


move towards its target position. This motivation can be represented by Equation 2. Parameter u) represents 


the desired speed, parameter pe ss represents the target position, parameter p; represents the current 


position, parameter v; represents the current velocity and parameter T represents the relaxation time with a 
value of 0.54 seconds. Note that the relaxation time is the time taken by agent i to approach the desired 
velocity. Also, unless stated otherwise, all constant values pertaining to the motion of agents in this work, 
follow the recommendations made by [14], which are based on the actual experiment that has been carried 
out. 
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The second component f'*, is the repulsive force between agent i and the obstacle wall. It 
describes the effects of interaction between them, as shown in Equation 3. Parameter d,, is the shortest 
distance between agent i and the wall, parameters a and b are constants with values of 3 and 0.1, 


respectively; and parameter ewall represents a unit direction vector from agent i to the nearest point on the 
wall. 
wall a wall (3) 
fi" =—a be; 
agents 


The final component f; , 1s the sum of repulsive forces between agent i and other agents j. It 
describes the effects of interaction between them, as shown in Equation 4. The interaction effects between 
agents « and j can be described in terms of speed and directional changes. The first effect which is 
represented by f,,, describes the deceleration along the interaction direction t;;. The second effect, on the 
other hand, is represented by fg, describing the directional changes along n;;, where nj,; is the normal vector 
of t;; oriented to the left. The deceleration and directional changes effects are described in Equation 5 and 6, 
respectively. 


fers > (huts + foni;) (4) 
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In both Equation 5 and 6, parameter A is a constant with a value of 4.5 and parameter d,; represents 
the distance between both agents, i and j. Both parameters n and 7 are the angular interaction constants with 
values of 3 and 2, respectively. Parameter 6;; denotes the angle between €;; and e;;, where €;; is the result of 
the calculation made by using Equation 7 and e;,; is a unit vector pointing from agent i to j. Parameter B is 
calculated from Equation 8. Parameter K used in Equation 6 represents the sign of 6;; that can be obtained by 
dividing the value of 0;; by the absolute value of 6;;. 


Di; 
“(Diy 
B=y|[Di\| ee 
Di; = A(v; =A v;) + Cij (9) 


Parameter D;,; in both Equation 7 and 8 represents the interaction vector between both agents, i and 
J, which is calculated by using Equation 9. Parameter y in Equation 8 and parameter A in Equation 9 are 
constants with values of 0.35 and 2, respectively, where the former parameter denotes the speed interaction 
and the later parameter represents a weight reflecting the relative importance of velocity against the position 
vector. Parameters v; and v; are the velocity of agents i and J, respectively. 
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2.2 Intelligent Agent Training Input 
The training input consists of 18 features as shown in Table 1. 


Table 1. Eighteen (18) Features for Training Input 


Agent Number of Features Detail of Features 
Intelligent Agent 2 velocity x, VXo 
velocity y, VYo 
Nearby Agent #1 4 position x, px) 


position y, py, 
velocity x, VX 
velocity y, vyi 
Nearby Agent #2 4 position x, pxX2 
position y, py2 
velocity x, VxX2 
velocity y, vy2 
Nearby Agent #3 4 position x, px3 
position y, py3 
velocity xX, Vx3 
velocity y, vy3 
Nearby Agent #4 4 position x, px4 
position y, py 
velocity x, VxX4 
velocity y, vy4 


In this work, half ellipse of influence is used to get the first four of the most significant nearby 
agents. This idea is similar to the Personal Reaction Bubble (PRB) in [15]. 


® \ Crowd Simulation using Social Force 


TARGET 





Action: Select a target [choose between keys ‘1!’ to '7] 


Figure 2. Graphical User Interface (GUI) for get training input 


Figure 2 shows seven waypoints that the agents may pass. These seven waypoints are also known as 
class labels. The combination of class labels and 18 features is also known as the training data for SVM. 

The agent is red is the agent that is being trained for making decisions (intelligent agent), while the 
agents in black are its neighbouring agents. Depending on the predetermined variable, the number of 
neighbouring agents can vary between 4, 5 or 6 agents. The intelligent agent is always initially position at the 
origin on the local coordinate system and has a fixed target along the y-axis as shown in Figure 2. Each 
neighbouring agents on the other hand, have random initial and target positions, both on the local coordinate 
system. During each training iteration, all agents will automatically move using the SFM as their control 
mechanism. Then, based on the trailing path coloured in orange, the user will select the best avoidance 
waypoint for the intelligent agent. 


2.3 Simulation of Intelligent Agent and Other Agents 

This research utilizes the OpenGL to visualize the position, movement and interaction of all agents 
in the scene. The scene is created in two-dimensional (2D) visualization since this research focuses on the 
behavioural aspect, rather than producing a high-quality visualization. All agents are represented in a circle 
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shape where the intelligent agent is coloured in red while the other agents is coloured in black. The agents 
have random initial and target positions. Obstacle walls, on the other hand, are represented with lines. The 
position of the walls is predetermined depending on the situation being simulated. 

Each agent has four important parameters to control its motion. The parameters are position p;, 


velocity v;, maximum speed u;"**, and target position or positions. Additionally, each target position is 


. ; ae target : target 
represented by a disk with a centre position p, 3& and radius r uae 


Three different situations are defined to test and experiment the proposed technique. The situations 
are the one-way corridor simulating the unidirectional flow of other agents, the two-way corridor simulating 
the bidirectional flow of other agents and finally, the four-way junction simulating the crossing flow of other 
agents. Note that, in all these situations, the intelligent agent will cross the flow of other agents. 


3. RESULTS AND ANALYSIS 
3.1 Control Window 

Figure 3 shows a control window where users can select multiple options. The window is divided 
into two main sections. The first section, groups the parameters to manage the simulation aspect of the 
system. There are two types of agents that the users can choose which is either normal or intelligent. Users 
can also choose the types of situations whether it is the one-way corridor, the two-way corridor or the four- 
way junction. Options for the number of agents are 100, 200, 300 or 400. For intelligent agents, the training 
models that the users can use for decision making are the training models for 4 agents, 5 agents and 6 agents 
or the combination of all three models. The users can click on the simulation button to start the simulation, 
the stop button to stop the simulation and the reset button to reset the simulation. The second section, groups 
the settings to manage the display aspect of the simulation. There are two forms to represent an agent which 
is either a triangle or circle. The users can also choose to display the statistics, velocity vector, vector to 
target and trailing path. 
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Figure 3. Control window 


3.2 Simulation Window 

Figure 4 shows an example of simulation in the case of an intelligent agent in a one-way corridor 
situation. The intelligent agent will move from the initial position to the target position while the other agents 
will move from left to right. The line at each agent shows the velocity vector for each agent, with each agent 
having different direction and length. This situation will create a high force from left to right. The intelligent 
agent will try to resist this force as the intelligent agent will move from top to bottom. The time taken for the 
intelligent agent to travel from the initial position to the target is displayed and recorded as part of the 
statistical analysis. 


Intelligent Agent Simulator in Massive Crowd (Mohamad, S.) 


582 Oj ISSN: 2502-4752 


8} Contr... 


| Simulation 


(= Inteltigent 


Situation: 


Training modal 4 agents 








Display 

Agent Shape 

@ Circle 

C Trangle 
[7 Statistics 
¥ Velocity vector 
[7 Vector to target 
7 Trailing path 


Close | 








1] ® | Agent with Support Vector Machine 


Simulaton M h i 

Agent Mode Ras ; 

@ Normal Situation Two-way Corridor 
C Intetigent Agents: 100 


Situation wo-Wway Corridor 4 Time: 6480rrs 








Agent Shage 
@ Circle 
( Trangle 


(7 Statistios 

(7 Velocity vector 
Vector to target 
¥ Trailing path 











Figure 5. Normal agent in two-way corridor situation 


Figure 5 shows a normal agent in a two-way corridor where some agents move from left to right 
while others move from right to left. The force is more balanced as compared to the one-way corridor. Since 
a normal agent is selected as the agent mode, there are no agents that are coloured in blue (agent or agents 
within the neighbourhood of the intelligent agent). 
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Figure 6. Intelligent agent in four-way junction situation 


Figure 6 shows the intelligent agent simulation in a four-way junction situation. Note that there are 
agents moving from left to right, right to left, top to bottom and from bottom to top. There are four blue 
agents which are the four neighbouring agents nearest to the intelligent agent. These neighbouring agents 
need to be considered when the intelligent agent is deciding the best route to take. 
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3.3 Discussion 

Based on the graph in Figure 7(a), when the number of agents is sparse (100 agents) in the one-way 
corridor, the intelligent agent reached the target at almost the same time as the normal agent. However, by 
increasing the number of agents from 200 to 400 and thus, making the scene more crowded, the result 1s 
different. The intelligent agent would reach the target faster than the normal agent. Similar analysis is also 
derived in the two-way corridor where the intelligent agent reaches the target in a shorter period of time as 
compared to the normal agent as shown in Figure 7(b). This shows that the intelligent agent is suitable to be 
used in crowded areas. 
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Figure 7. Comparison between normal agent and intelligent agent simulation based on number of agents 
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Figure 8. Path trailing comparison in crowded and sparse areas 


Figure 8 shows the trailing path between the crowded and sparse areas. Crowded areas have a higher 
force as compared to the sparse areas. This will make it more difficult for the intelligent agent to get to the 
target because there is a higher force from left to right. It can also be observed that the trailing path of the 
intelligent agent will be less direct in crowded areas as compared to the less crowded areas where its path to 
the target position will be more direct. This simulation shows that when the agents are in a crowded area, 
they will be more affected by the force surrounding them. Therefore, it will be more difficult for them to 
decide the best route to take. 


4. CONCLUSION 

Based on the findings obtained, the resulting simulator is proven useful to show the movement of 
normal agents and intelligent agents in a crowded environment. Some parameters can be altered in the 
control window to make it easier for the users to carry out the analysis based on the simulation results. In the 
future, as an addition to the three existing situations, other situations can also be included in this simulator, 
such as circular movement (i.e. ‘tawaf’) or random movement, to observe any differences. 
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